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Abstract —This letter presents a distributed algorithm for 
aggregating a large number of households with mixed-integer 
variables and intricate couplings between devices. The proposed 
distributed gradient algorithm is applied to the double smoothed 
dual function of the adopted DR model. Numerical results show 
that, with minimal parameter adjustments, the convergence of 
the dual objective exhibits a very similar behavior irrespective 
system size. 

Index Terms —Dual decomposition, accelerated gradient meth¬ 
ods, demand response, smoothing technique, mixed-integer vari¬ 
ables. 

I. Introduction 

E FFICIENT load scheduling and aggregation is a problem 
of growing importance in the area of demand response 
(DR). However, this problem is particularly difficult for two 
main reasons. First, many household electrical devices have 
discrete operating points that can only be represented by 
mixed-integer variables, and moreover, household device uses 
are often coupled, thus giving household electricity demand a 
combinatorial structure. Therefore, solving this problem cen¬ 
trally may spell intractability when the number of households 
is large. Second, solving this problem centrally would require 
sending all of the households’ private information to the 
aggregator, which entails substantial communication overhead 
and privacy concerns. 

Against this background, this letter proposes a distributed 
gradient algorithm applied to a double smoothed dual function. 
This work is not the first attempt to solve a DR problem with 
mixed-integer variables in a distributed fashion. This problem 
is decomposed in terms of devices and solved in a distributed 
fashion using the proximal bundle method in HI. In contrast 
to ©, the DR problem in this work is decomposed in terms of 
households. Doing so, allows for a more expressive household 
model, which can incorporate the intricate couplings between 
storage devices, appliances and renewable energy resources. 

II. DR MODEL AND PROBLEM DESCRIPTION 

The model comprises a set of agents I := {0,1,2,..., /}, 
where 0 is the aggregator and each i ^ 0 is a household agent. 
Let x\ £ K.+ be the demand for electric energy for every agent 
i ^ 0 at time-slot t £ T := {r,..., r+T— 1}. The aggregator 
faces a set of cost functions C* : R+ i —> R + , where C 4 (xq) 
is the cost of supplying Xq units of energy to the households 
at time-slot t. 

Given the households’ feasible schedule sets X^o and 
their demand profile Xi = \x\,.. ., a;f +T_1 ], the aggregator 


can (centrally) minimise the total energy cost per scheduling 
horizon T by solving the following problem: 

jnin ( x o) > ( la ) 

teT 

subject to X x \ = Xq, t £ T. (lb) 

iex\o 

The local constraints of agents i ^ 0 arise from the operating 
modes of different flexible loads including interruptible (e.g. 
PHEVs, pool pumps) and non-interruptible (e.g. washing 
machines, dishwashers) loads (as in ID, El)- Problem © 
can also be written as V* = ird x& x {C (x) : A c x = 0}, 
where x = {a X = and A c is the coupling 

constraint matrix. 

Problem © is a mixed-integer program (MIP) that belongs 
to the class of NP-hard problems which are notorious for 
tending to be intractable (if solved centrally) when they 
grow in size. However, relaxing the coupling constraints 
OB, through the Lagrangian relaxation method, bestows a 
separable structure on problem ©. The problem can then be 
decomposed into 7 + 1 independent subproblems that can be 
solved in parallel. The partial Lagrangian of problem © can 
be written as 

£(x,A) = ^G‘( a; ‘)+^A t I £ xl-xU , (2) 

teT teT \iex\o / 

where A = [A r ,..., A T+r ~ 1 ] is the vector of Lagrange 
multipliers. Therefore, the Lagrange dual function would be 

V (A) = inf C (. x , A) = V 0 (A) + T>i (A), where (3) 

iez\ o 

V Q (A) = inf V] (C rt (xq) - A*a;g) , and (4) 

x ° eX ° teT 

Vi (A) = inf Y A t x\, i£l\ 0. (5) 

XiGXt 

teT 

Finally, the dual problem is maxx>-o E> (A). However, in 
this DR scenario, the concave dual function V (A) is typically 
nondifferentiable. Specifically, as the subproblems in © can 
have multiple optimal solutions for a given vector A, the dual 
function T> (A) can be nonsmooth. Consequently, applying 
a conventional gradient method a to this problem would 
exhibit a very slow convergence. 

III. Double smoothing method 

One way to obtain a smooth approximation of T> (A) is 
to modify the subproblems in © to ensure a unique optimal 
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solution for every A. The dual function is modified as follows: 
(A) = V 0 (A) + ^ V l4l (A), where (6) 


Vi^ (A) = inf 


Xi^Xi 


i£l \0 


5Z A*x‘ + | II Xi 
KtcT 


i€l\ 0, (7) 


and /I > 0 is a smoothness parameter. The modified dual 
function V^ (A) is smooth and its gradient (A) = 

AcX i: ,\. where x t , x denotes the unique optimal solution of 
problem is Lipschitz-continuous with Lipschitz constant 
IIAcll 2 


Ln = 

t 1 fi 

The aim of this smoothing is to obtain a Lipschitz- 
continuous gradient for which efficient smooth optimisation 
methods can be applied 0. However, despite having a good 
convergence rate V^ (A*)— V^ (X k ) at iteration k when apply¬ 
ing a fast gradient method, the same good rate of convergence 
does not apply to \\W^ (Afc)||. 

Since the aim is not only to efficiently solve the dual 
problem but also to recover a nearly feasible solution to the 
primal 0, a second smoothing is applied to the dual function 
to make it strongly concave. The new dual function is written 
as 


W = v o (A) + £ (A) - - || A|| 2 , (8) 

i£Z\0 

which is strongly concave with parameter k > 0, and whose 
gradient VD jl K (A) = A c x^ \ — kX is Lipschitz-continuous 
with constant + k. 


IV. Fast gradient algorithm 
The fast gradient method involves two multiplier 
updates, Afc+i — A k + jf- —^Afc) , 

and A fc+ i = X k +i + /3 k (A fc+ i - \ k ), where 

P k = {y/ Lk ^, K " - + ' 

The parameters of the algorithm are set as follows, 
/u fc+1 = a k+1 /D x , and n k+1 = e ( 1 °s(" , ™"/" 1 )/ manter ) K fc ) 
where a k+1 = e ( 1 °s(“ m “ i “ r /« 1 )/m™ter) Q ,fe i and maxiter is the 
maximum number of iterations. The distributed algorithm is 
described in Algorithm Q] 


Algorithm 1 : Distributed algorithm 

Parameters: Ai fc 0. k. 1 > 0, K n ' a,liKr = 0.0001, pT" e [0.0001,0.005], 
maxiter G {500, 1000}. 

l: Initialisation: Households compute E)x i = min ||*i|| 2 : Xi G Xi } , and 
send it to the aggregator which computes Dx — an d se ^ s 

p 1 — a 1 /^, A 1 — p 1 ■, Ai — Ai, J = 1 and k = 1. 


2 : while k < maxiter do 

3: Aggregator solves T> o(Afc) and broadcasts A*, and p k to the households which 

solve IX (Afc) and return x i ^fc ^ to the aggregator. 

4: Aggregator computes VXXfc K fc(Afc) and the primal 'Pj^ = 

Zlter ct (X) ie z\o A fc )• 

5: Aggregator computes L k ^ k ^ -1- K k and updates Afc_|_i and Afc+i. 

6: Aggregator updates p k+1 and K k+1 and sets {/i fc_ * -1 = p k+1 : p k+1 > 

r n }. 

7: k k + 1. 

8: end while 

Output: Aggregator finds the best recovered primal solution Pf along with A j, p J 
and x.j kj such that J := {k : Vf = min{{V k } k&{1 ^.^ maxitei} }}. 
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Fig. 1. Evolution of the primal and dual objectives for the I = 1280 case. 

TABLE I 

Difference between F/ and V*. 


/ 

F r J ($) 

P*($) 

Gap (%) 

/'.min 
h L 


640 

76049.78 

75732.03 

0.42 

0.0004 

10 

1280 

304089.52 

302927.74 

0.38 

0.001 

10 

2560 

1216367.92 

1211711.03 

0.38 

0.0015 

10 


V. Numerical evaluation 

Algorithm Q] is tested on three scenarios, each with one 
aggregator and 640, 1280 and 2560 households respectively, 
each with 10 appliances scheduled over T = 24h (as in 12). 
In all three scenarios, Algorithm |T| is initialized with Ai = 0, 
k 1 = 10, maxiter = 1000, a 1 = 3 x 10 -4 ||A C || 2 Dx and 
a maxiter _ g x 10~ 8 || A c || 2 Dx■ The simulation results along 
with the corresponding parameter values are listed in Table [Q 
Table U| shows that the difference between the recovered best 
integer feasible solution Vf and the optimum solution V* 
does not exceed 0.42%, which corroborates the claim that a 
near-optimal solution can be recovered in a limited number 
of iterations. Finally, the evolution of V k and V^k K k(X k ) 
in the / = 1280 case is displayed in Figure Q] which also 
shows a quick and smooth convergence of the dual objective 
Vpk n k {X k ) and a small duality gap upon termination. 

VI. Conclusion 

The aim of this work is to implement a fast gradient 
algorithm applied to the double smoothed dual function of 
a DR problem comprising expressive household models and 
mixed-integer variables. This work also demonstrates how to 
recover a near-optimal solution in a fixed number of iterations 
and minimal parameter tweaking. 
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